
STOP 



Early Journal Content on JSTOR, Free to Anyone in the World 

This article is one of nearly 500,000 scholarly works digitized and made freely available to everyone in 
the world byJSTOR. 

Known as the Early Journal Content, this set of works include research articles, news, letters, and other 
writings published in more than 200 of the oldest leading academic journals. The works date from the 
mid-seventeenth to the early twentieth centuries. 

We encourage people to read and share the Early Journal Content openly and to tell others that this 
resource exists. People may post this content online or redistribute in any way for non-commercial 
purposes. 

Read more about Early Journal Content at http://about.istor.org/participate-istor/individuals/early- 
journal-content . 



JSTOR is a digital library of academic journals, books, and primary source objects. JSTOR helps people 
discover, use, and build upon a wide range of content through a powerful research and teaching 
platform, and preserves this content for future generations. JSTOR is part of ITHAKA, a not-for-profit 
organization that also includes Ithaka S+R and Portico. For more information about JSTOR, please 
contact support@jstor.org. 



THE CLEVELAND SURVEY TESTS IN ARITHMETIC 
IN THE MIAMI VALLEY 



J. W. HECKERT 
Miama University 



During February, 1917, the arithmetic tests used in the Cleve- 
land Survey were given in a number of the smaller cities and villages 
and also in a considerable number of the rural schools of the Miami 
Valley in southwestern Ohio. To be more specific, there were rep- 
resented seven city and village systems and all the rural schools of 
one county and those of one of the several supervision districts of 
another county. The purpose in giving the tests was to find out 
the quality of work done along abstract lines (i) in the several 
systems individually, (2) in all the city and village schools as com- 
pared with all the one-room rural schools, and (3) in the city, vil- 
lage, and rural schools as compared with the Cleveland schools. 
The tests were given under the direction of Professor W. S. Guiler, 
of the Teachers' College of Miami University, and the papers were 
scored and the results compiled by the graduating class of that 
institution. About three thousand papers were obtained, quite 
evenly divided between town and rural schools. The reason why 
there was not a larger number of papers from the town schools is 
that the tests were given to representative schools in the larger 
places only. It was found impossible on account of Hmitations of 
time and labor to give them to all the schools of these systems. 

The results obtained are indicated in Table I. The first score 
in each set is the median for the Cleveland schools. The second 
is the score of the city and village schools, and the third that of 
the rural schools participating in this survey. 

Set A. — The children of the city and village schools have made 
a good start in simple addition in the fourth grade. There is con- 
siderable improvement up to the eighth grade, however, and the 
rate of progress is quite consistent, which is contrary to the findings 
in Cleveland. Village and city schools make as good a score in the 
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TABLE I 



Grades 



7 



Set A:_ ^ 
Addition of one-place numbers 

SetB: 

Subtraction of one-place numbers 

Set C: 

Multiplication of one-place numbers 

Set D: 

Division of one- or two-place numbers 
by one-place numbers 

Set E: 
Addition of s ngle columns o£ five figures 

Set F: 

Subtraction of three-place numbers 
from three- and four-place numbers 

Set G: 

Multiplication of four-place numbers by 
one-place numbers 

SetH: 

Addition and subtraction of fractions 
with common denominator 

Set I: 

Division of five-place numbers by one- 
place numbers 

Set J: 

Addition of single columns of 13 figures^ 

Set K: 

Division of two- and three-place num- 
bers by two-place numbers 

SetL: 

Multiplication of four-place numbers by 
two-place numbers 

Set M: 

Column addition of s four-place num 
bers 

Set N: _ 

Division of iive-place numbers by two- 
place numbers 

SetO: 

x\ddition, subtraction', multiplication, 
and division of fractions 



17.8 
17.8 



13-4 
10.6 



12.0 
IO-5 



12.4 



9.2 

5-3 
3-8 



4-9 
3-4 



3-9 
2.9 



0.0 
0.0 



I . I 
0.6 



3-2 
2.0 



4.0 
1-7 



1-7 
1 .0 



2-5 

1.6 



0.8 

0.=; 



0.0 
0.0 



22.5 

21.3 
19.8 

17.2 

I4S 

15-5 
12. 2 
12. 7 

iS-7 
12.3 
12.9 

6.3 
4-9 
4-1 

6.7 
S-i 
4-7 

5-2 
3-8 
3-8 

S-o 

2.7 

2-5 

2.0 

0.9 

1 .1 

4.0 

2.0 

2-5 

6.8 

2-5 

31 

2-5 

1.8 
0.9 

3-2 
2.4 

2.4 

1-3 
0.6 



0.7 



24.8 
23-4 
23-3 

19.8 
16.0 
139 

16.6 
14.6 
16.2 

18.5 
I4-S 
15-8 

6.8 

5-0 
4.8 

7-S 
6.1 
6.8 

5-S 
4-4 
5-0 



4-4 
3-4 

3-2 

8.S 
4-1 
S-i 
2.8 
3-4 
1.6 

3-8 
3-2 
i-3 

1-7 
0.0 
0.8 

31 

2-5 
2.6 



26.7 

26.6 

25-1 
21-5 

18.9 
193 

17.7 
16.8 

17.8 

20.8 
173 

17-3 

7-5 
5-8 
5-4 
8.6 
7-3 
7-1 

5-9 
S.8 

S-2 

7-7 
3.8 
6.4 

4.0 

2.7 
2.9 

4-9 
3-8 
3-8 

10. 1 
6.3 
6.9 

3-2 

3-2 

2.9 

4-4 
3.6 

2.4 

2.0 

1-3 
I . I 

41 
2.9 
30 



27-5 
29.2 
29.8 

26.0 
21.0 
22.9 

19.0 
16.9 
19-3 

22.5 
18.9 
22.4 

7.8 
6.1 
6.7 

10. 1 

8.0 
9.9 

6.6 
5-9 
6.3 

8.5 
4.8 

8.3 

4-7 
3.8 
3-8 

5-7 
4.6 
4.6 

12. S 

7-7 
9-5 

3-9 
3-8 
4-1 



5-5 
3-4 
3-8 
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fourth grade, and both city and rural schools excel the Cleveland 
score in the eighth grade. 

Set B. — Pupils do not do so well as in simple addition. The 
score throughout the grades is lower than in Cleveland. Appar- 
ently subtraction is more poorly taught than in Cleveland because 
in Set F, too, the schools in the Miami Valley are doing rather poorly 
as compared with those of Cleveland. Individual schools, however, 
excel the median for Cleveland in certain grades. No such marked 
superiority of eighth-grade over seventh-grade pupils was found as 
in Cleveland except in case of Set F, where the eighth grades of the 
rural schools excel the score of the seventh grades by 2.8 points, 
the greatest increase along the line. 

Set C. — Both village, city, and rural schools make unsatisfactory 
scores; they also fall below the Cleveland median except in the case 
of the seventh and eighth grades of the rural schools, which slightly 
excel the Cleveland schools. On the whole the rural schools did 
decidedly better than the city and village schools taken as a group. 
One of the village schools, however, exceeds the record of all rural 
schools by o . 5 point. The rate of improvement for Grades 6 to 8 — 
Grade 8 of the city systems excepted — in both types of schools is 
greater in this set than in the Cleveland schools. 

Set D. — Here again village and city schools make a rather poor 
showing in the fourth grade, 9.2 as compared with 12.4 of the 
Cleveland schools. This is brought about largely, as in the preced- 
ing tests, by the poor showing of one of the systems in which the 
median for this grade is 5. The rural schools too make a rather 
mediocre showing as compared with the Cleveland score, 12.9 
against 15.7 (fifth grade). The gain from grade to grade is but 
slight until the eighth grade is reached. In this grade the rural 
schools exceed their seventh-grade score by 5 . i points, almost 
equaling the Cleveland standard. Village and city schools do not 
reach the final score which one had a right to expect from the per- 
formances of the earlier grades. This is due to the low scores of 
two of the systems (4 and 6) in the eighth grade. 

Set E. — The results in this test are disappointing from the point 
of view of schools taken both individually and jointly. Judd points 
out that the Cleveland scores are relatively higher for this column- 
addition test than for the simple-addition test. Set A. This is not 
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true for the schools included in this survey. In practically every 
instance the score is below both the Cleveland standard and the 
record made in Set A. Evidently too little emphasis is placed upon 
column addition and too much upon simple addition in the schools 
measured; for while they ranked below the Cleveland scores in 
Set E they ranked above them in Set A. This is especially true of 
individual schools. 

Set F. — The scores are again somewhat below the Cleveland 
standard although the eighth grade of the rural schools is only o. 2 
point below the Cleveland median. There is no decided increase 
from the seventh- to the eighth-grade median except in case of the 
rural schools. The rate of increase from the fourth to the eighth 
grade in city and village schools varies from 0.7 to 1.7 points, the 
average being 1.15. The eighth-grade score is 0.7 point above 
that of the seventh grade, less than the average increase of all 
grades. In the case of rural schools, however, we find the sharp 
increase in the eighth-grade score over that of the seventh grade; 
but there is a similar increase in the case of the sixth-grade score 
over that of the fifth. It would seem from these data that a sharp 
increase in the eighth-grade score over the seventh-grade score due 
to greater maturity of pupils as asserted by Judd is not general. 

Set G. — If we leave the eighth grade out of consideration there is 
a fairly consistent improvement from grade to grade in city and 
village schools. The rate of improvement is considerably greater 
in Grades 6 and 7 of city and village schools than in the same grades 
of the Cleveland schools, while in the rural schools the sixth and 
eighth grades excel the corresponding grades of the Cleveland sys- 
tem. The fifth grade of the city schools attains a score of 0.9 
point above that of the fourth grade; the sixth grade makes twice 
as great an improvement over the fifth grade as in the Cleveland 
schools; the seventh grade here makes the greatest of all gains, 
1.4 points, three times that of the Cleveland schools. The eighth 
grade makes the least improvement. In the rural schools there is 
a very decided improvement in the sixth and eighth grades, but 
only a very slight one in the seventh. Furthermore, with the excep- 
tion of the sixth grade, the rate of progress from grade to grade of 
city and village schools in Set G is fairly consistent with that of 
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Set C, as may be shown by a comparison of gains made by both the 
city and the village schools in the two sets. For rural schools this 
is not the case. The gains are shown in Table II. As far as results 
in this test go there is but slight indication that the rate of progress 
with this complex form of multiplication closely correlates with the 
maturity of the pupils tested. In general, no doubt, this is true, 
but in this particular test it is questionable whether the greater 
maturity of the pupils is the cause of the comparatively high score 
made in the Cleveland schools. 



TABLE II 





Grades 


Set 


S 


6 


7 


» 




City and Village Schools 


C 

G 


1-7 
0.9 


2-4 

0.6 


2.2 
1.4 


0. I 
0. I 




Rural Schools 




C 




3-5 
1 .2 


1,6 

0. 2 




G 













Set H. — ^Judging by the returns from this test the teaching of 
fractions appears to be but poorly accomphshed in some of the 
systems tested. City and village schools as a whole made a poorer 
score than either the rural schools or Cleveland. Both at the start 
and in the final grade do the city and village schools measured fall 
behind the Cleveland standard, more so than in any other test of 
the series except K, long division. More surprising still is the fact 
that certain systems make their highest scores in the fifth and 
eighth grades, the scores in Grades 6 and 7 being lower than those 
of the fifth grade. Evidently some changes in the courses of study 
or in their administration are needed to overcome this difficulty. 
Apparently no real effort is made to apply the knowledge of frac- 
tions which children have gained in the fifth grade during the follow- 
ing two years of school. While the rural schools are decidedly below 
the Cleveland score in the fifth grade they make a very creditable 



452 



THE ELEMENTARY SCHOOL JOURNAL 



showing in the later grades, excelling Cleveland in the sixth grade 
and almost equaling the Cleveland median in the eighth grade. 

Sets I, K, N {division). — The form of progress of the schools 
measured differs materially from that of the Cleveland schools in 
each of these tests, as may be seen from Table III. This table 
should be read as follows : In Cleveland the fifth grade made a gain 
of 82 per cent upon the score of the fourth grade in Set I, while the 
corresponding grade in the city and village schools measured shows 
an increase of only 50 per cent. From this table it will be seen that 
in city and village schools progress in the sixth and seventh grades 
is decidedly greater than in the corresponding grades in Cleveland 

TABLE III 

Rate op Progress in Sets I, K, and N Compared 





Division 
Tests 


Grades 




S 


6 


7 


8 


Cleveland 

City and village 


Ik;.::::: 

IN 

\1 

•K 

N 

fl 


0.82 
0.70 
0.62 

0.50 
0.47 
0.20 


0-55 
0.25 
0.30 

0.88 
0.64 


0.29 
0.18 
0.17 

0.58 

0-S3 
1. 16 

0.38 
0.3s 
0.37 


0.17 
0.23 
0.30 

0.40 

0.22 
0.23 

0.31 
0-37 
0-54 




0.90 
0.64 


Rural 


■^K. . . . 






N 













except in the case of Set N. In this test the sixth grade fails to 
score. The gain of the eighth grade over the seventh grade is 
greater than in Cleveland in Set I, but somewhat less in Sets K 
and N. In case of the rural schools we have the greatest gain in 
the sixth grade, the first grade where gain can be measured, in 
Sets I and K, but no increase in Set N. The gain of the seventh 
and eighth grades in Sets I and K is decidedly less than in the sixth 
grade, corresponding to the Cleveland rate of progress, while in 
Set N there is a very positive increase for the last two grades which 
is contrary to the Cleveland score. It is inconceivable that the 
very poor showing in Set N is due entirely to the complexity of the 
exercise. It is more likely to be due to the fact that teachers fail 
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to see the importance of teaching children rapid methods of deter- 
mining a quotient by the use of an approximate trial divisor. To 
divide 36,084 by 97 is practically no more difficult than to divide 
the same number by 17, provided the pupil has been taught to use 
100 as the approximate divisor instead of 97. In so far as there 
is any difference this is due to the greater difficulty of multiplying 
by 9 rather than by i. 

Sets E, J, M (addition). — The schools measured fall below the 
Cleveland standard in all three of these tests, most of all in Set E, 
and least in Set M. The rate of progress in city schools decreases, 
although not regularly, in Sets E and M from the fifth to the eighth 

TABLE IV 
Rate of Progress in Sets E, J, and M Compared 



School 


Column- 
Addition 
Tests 


Grades 


S 


6 


7 


8 


Cleveland 


jfv:::::: 

[m 

fE. 

J 


0.18 
0.25 
0.28 

0.28 


0.08 
0,10 
0.18 

0.02 
0.70 
0-33 

0.17 
0.28 
0.29 


O.IO 

0.11 
0. 16 

0.16 

O.II 

0.13 

0.12 

0.18 

-0.27 


0.04 


City and village 


0.18 
0.05 


[m 

fE 


0.50 


0.19 

0. 24 
21 


Rural 


J.. . . 






M.. . . 




0.83 









grade, and is erratic in Set J, in which the sixth grade makes an 
exceptional gain. In case of the rural schools there is an increase 
from the sixth to the eighth grade in Sets E, J, and M. The unusual 
element in these tests is the unsatisfactory work of the seventh 
grade, in Set M especially. Closer supervision of this part of the 
work and possible changes in the courses of study suggest themselves 
as means to overcome these unsatisfactory conditions. Table IV 
shows the rate of progress from grade to grade in these three tests. 
It should be read : Grade 5 of the city and village schools makes 
a gain of 28 per cent upon the score of the fourth grade, etc. 

Set O. — Some of the schools measured do not study fractions in 
any serious way until the sixth grade is reached, while others begin 
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in the fifth grade. This accounts for the low scores of both city and 
rural schools in the earlier grades. It does not justify the poor 
progress in the later grades and the comparatively low final attain- 
ment of both classes of schools. While the scores for both classes 
of schools indicate fairly consistent progress, individual schools var}- 
considerably from the general tendency. Thus one system making 
a score of 3 . i in the fifth grade never again rises above 2.5. Appar- 
ently fractions are "finished" in the fifth grade and never again 
studied in any systematic way. Reorganization of the course in 
arithmetic should make for more uniform and greater progress in 
this system. 

VARIABILITY OF CHILDREN AND SCHOOLS 

WHAT DOES GRADUATION FROM THE RURAL SCHOOL SIGNIFY? 

VARIABILITY AMONG CHILDREN 

Assuming that the lowest 10 per cent of pupils will fail to com- 
plete their work in the eighth grade, it means that a graduate from 
this grade can write the answers between the limits indicated in 

Table V. 

TABLE V 

Set 



A from 


21 


to S4 


Set I 


from 


I to 8 


B « 


IS 


" 40 


" J 


u 


I " 10 


C " 


13 


" 45 


" K 


it 


3 " 18 


D " 


IS 


" 38 


" L 


u 


I « 9 


E « 


s 


" 19 


" M 


a 


I " II 


F " 


s 


" 19 


" N 


u 


« 6 


G " 


3 


" 13 


" 


u 


" 12 


H " 


3 


" 24 









In city and village schools pupils in the eighth grade — omitting 
the lowest 10 per cent — vary as shown in Table VI. 







TABLE VI 












A from 


21 


to SS 


Set I 


from 


I 


to 


9 


B " 


13 


" SO 


" J 


u 


2 


u 


10 


C " 


II 


" 32 


" K 


u 


I 


u 


9 


D " 


12 


" 38 


" L 


a 


I 


u 


24 


E " 


3 


" 12 


" M 


a 


I 


a 


9 


F " 


S 


" 16 


" N 


u 





u 


5 


G " 


3 


" 13 


" 


u 





a 


10 


H " 





" 15 













Unless 10 per cent of the children fail to be promoted, the varia- 
bility is considerably greater, the lower limit extending to zero in 
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every test except D for the rural schools, and D, F, and G in city 
and rural schools. 

VARIABILITY AMONG SCHOOLS 

Not only is there considerable variability among pupils taking 
the test, but the same is true of schools. In the case of city and 
village schools the scores attained vary, as may be' seen in Table VII. 

The rate of progress from grade to grade is very uncertain. 
Thus System IV, while uniformly low in the fourth-grade scores 
owing to the influx of foreign children at this point, makes very 
decided progress from the fourth to the fifth grade. But from this 

TABLE VII 



Set 


Grades 


4 


S 


6 


7 


8 


A 


13 6-19-9 
7.0-12.9 
5.9-14-3 

5-0-I2.5 
3.0- 4-7 
2.6- 4.7 
2,1-3.7 
0.0- 0.0 

O-O- 1.2 

1-4- 2.5 
0.0- 2.6 
0.0- 2.7 

1.2- 2.5 

0.5- 0.8 
0.0- 00 


19.0-24.0 
I 2. 4-19. I 
IO.I-17-5 
IO.O-I7-6 

3-8-5-6 
4.5- 6.7 
2.0- 4.5 
0.0- 7. I 
0.0- 1.8 
2.0- 4.0 
1.8- 6.5 
I .0- 2-4 

i.o- 3-3 
O-O- 0-7 
0.0- 3.1 


20.0-26.7 
14 - 4-20 - 6 
11-0-18-6 
11-O-18-4 
4-1- 5.8 
4.0- 7.6 

3-1- S-3 
I -I- 6-0 

1-3- 4-3 

2-0- 4,1 

2.8- 5.0 
1-8- 3-8 
2-3- 4-6 
0.0- 2.6 
!•<>- 3-5 




26-3-32,3 
19.2-24.0 
14-O-19.8 
18 8-21 


B 


16.0-26 

13. 7-19 

15-4-22 

3.0- 6 

6.0- 8 
4-6- 5 
I -0- 4 

1.9- 4 

2-7- 4 

5.1- 9 
2.6-5 

3.0- 4 
0.0- I 
2.4- 4 


7 

5 
3 
8 
8 
7 
8 
6 
3 
3 
2 
8 
6 


C 


D. 


E 

F 


5-0- 6.7 
6,7-10.5 

5.4- 6.2 
2.8- 9.0 
3-1- 4-6 
4-0- 6-6 

6.3-17-3 
3-3- 5-6 
3.7- 4.8 
I .0- 2.6 

2.5- 5-3 


G 


H 


I 


T 


K 


L. 


M- - 


N 


O 







point progress is often very slow, and in at least one test (H) the 
fifth-grade score in this system is the highest attained by any grade. 
The score in Set E of the fourth grade in System VIII is o . i of a 
point higher than that of the seventh grade in the same system; 
but the eighth-grade score is 66| per cent higher than that of the 
seventh grade. The same system in Set H makes a score of 4 . 5 in 
the fifth grade, 5 in the sixth grade, i in the seventh grade, and 
5 . 8 in the eighth grade. In Set I of this system the scores from 
the fourth to the eighth grade are 0.0, 1.9, 1.9, 4.4. The same 
variability in rate of progress from grade to grade might be illus- 
trated from every system tested. While the decreased rate of 
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progress in some instances may be due to lower mental ability on 
part of the grade as a whole, undoubtedly many times it is due to 
poorer teaching or to an unsatisfactory course of study. Supervi- 
sors should ascertain whether it is the one or the other cause which 
makes for poor work. 

RELIABILITY OF TESTS AS COMPARED WITH TEACHERS' GRADES FOR 

THE MONTH IN INDICATING ACCURATELY THE MERIT OF THE 

INDIVIDUAL pupil's WORK IN ARITHMETIC 

A single performance of an individual along any line commonly 
is not a true indication of his ability in this particular. In order 
to ascertain how accurately these tests indicated the rank of a pupil 
in his class the total scores for all tests and from Sets I to were 
compiled for the pupils of one school in one of the city systems. 
The teachers were then requested to furnish the grades of these 
pupils for the month during which the tests were given. The 
Pearson method adapted to rank differences was used in deter- 
mining the correlations. The results were as follows: 

Monthly Grade in Arithmetic with Total Score 
from Tests I to O 

Grade 8 , 0.55 

" 7 ' 0.64 

" 6 0.58 

" S 0.47 

When the total scores from all the tests (A to 0) were used in com- 
puting the correlation, coefficients were found to be somewhat less 
than the foregoing, with a single exception. 

The correlation was shown in another way. Pupils were 
grouped, first, upon the basis of the teacher's monthly grade in 
arithmetic: pupils ranking between 91 per cent and 95 per cent 
were called Group I, those ranking between 86 per cent and 90 per 
cent were called Group II, etc. They were then grouped upon the 
basis of their total scores in Tests I to O inclusive: those ranking 
between 43 and 48 points were included in Group I, those ranking 
between 37 and 42 points constituted Group II, etc. Table VIII 
shows the relations of these groups. It should be read as follows: 
In Grade 8, 25.9 per cent of those who ranked in Groups I, II, III, 
etc., according to their teacher's marks also ranked in Groups I, 
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II, III, etc., upon the basis of points made in Tests I to inclusive; 
37. 1 per cent of those who ranked in Groups I, II, III, etc., in the 
first series ranked in Groups II, III, IV, etc., or vice versa; there 
was a diiference of one step in the two ratings. 





TABLE VIII 








Grade 8 






25 . 9 per cent of the two 


rankings 


agreed 


37.1 " 


U U 


u 


were 


1 Step apart 


22.6 " 


a u 


u 


a 


2 steps " 


II. I 


u u 


u 


a 


3 " " 


3.3 " 


u u 


u 
Grade 7 


a 


4 « « 


21.4 per cent of the two 


rankings 


agreed 


51.8 " 


a a 


u 


were 


I "step apart 


17.9 " 


u ' u 


a 


a 


2 steps " 


5-4 " 


it a 


u 


11 


3 " " 


3-5 " 


u u 


u 


a 


4 " « 




CONCLUSIONS 





1. The score attained by the two groups of schools is less satis- 
factory than that of the Cleveland schools. The rural schools in 
35 out of 60 instances have done this formal work slightly more 
satisfactorily than the city and village schools taken as a group, 
although there are individual schools in the latter group that excel 
the rural-school median in many instances. 

2. While the rate of progress from grade to grade as indicated 
by the total scores in Table I is quite consistent, this is not the case 
when individual school systems are considered. In fact, in case of 
the latter this is both uncertain and unsatisfactory. Either the 
course of study, poor teaching, or the weakness of a certain grade 
may account for this difficulty. 

3. Courses of study should make definite provision for the 
reviewing of essentials from grade to grade. This should not be 
left to the discretion of the teacher. 

4. Supervisors of teaching must see to it that drills are provided 
in each grade which will reach all the children. The large number 
of children making a very low score would indicate that present 
methods of procedure are not reaching them. 



